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PACKET PROCESSING DEVICE AND METHOD 



(57) There is provided a packet processing device 
for, when decoding variable length data that is split into 
packets, realizing a reduction in processing load at a de- 
coder, by providing information for identifying a start po- 
sition of the data. A header analyzing section (1 1 ) deter- 
mines whether data stored in a packet is start data con- 
taining start information or other data. A data extracting 



section (12) extracts data from a packet and stores the- 
datainabuffer(13). Abuffercontrollingsection (14) causes 
a start position memory (15) and a number-of -starts 
counter (1 6) to retain an address position and the number 
of start data stored in the buffer (13). A decode section 
(20) refers to the start position memory (15) and the 
number-of-starts counter (16) and executes a decode 
process for the data stored in the buffer (13). 
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Description 

TECHNICAL FIELD 

[0001] The present invention relates to a device and 
method of packet processing. More particularly, the 
present invention relates to a packet processing device 
and a packet processing method for decoding compres- 
sion-encoded image data, audio data, and the like from 
packets in which variable length data is split and stored. 

BACKGROUND ART 

[0002] In recent years, in digital broadcast and the like 
based on CS and BS, MPEG (Motion Image Experts 
Group) technique is adopted as an encoding technique 
for compressing image data, audio data, and the like. 
Therefore, a reception device and a recording/reproduc- 
tion device for digital broadcast and the like need to com- 
prise a device which decodes a bit stream of data that is 
compression-encoded by MPEG technique. 
[0003] Now, MPEG2 technique, which is mainly used 
in a digital broadcast, will be briefly described. In MPEG2 
technique, a bit stream of compression-encoded image 
data, audio data, and the like is referred to as an elemen- 
tary stream (ES) . As a packet structure for carrying this 
elementary stream, PES (Packetized Elementary 
Stream) is defined. FIG. 15 is a diagram illustrating a 
detailed structure of a PES packet. Further, in MPEG2 
technique, a PES packet is split into a predetermined 
unit, stored in a transport stream packet (hereafter, re- 
ferred to as a "TS packet"), and broadcasted. FIG. 16 is 
a diagram illustrating a detailed structure of a TS packet. 
FIG. 1 7 is a diagram describing the relationship between 
TS packets and PES data. 

[0004] For this reason, a device handling a bit stream 
under MPEG2 technique needs to perform a packet proc- 
ess, i.e., extracting PES data from a plurality of TS pack- 
ets and decoding it. Hereinafter, this packet process will 
be described. 

[0005] FIG. 18 is a block diagram illustrating an exem- 
plary construction of a MPEG decoding device perform- 
ing a conventional packet process. In FIG. 1 8, a conven- 
tional MPEG decoding device 1 01 comprises aTS head- 
er analyzing section 1 1 1, a PES extracting section 112, 
a PES buffer 1 13, a PES buffer controlling section 114, 
and a MPEG decode section 120. The TS header ana- 
lyzing section 1 1 1 , the PES extracting section 112, the 
PES buffer 113, and the PES buffer controlling section 
1 1 4 together constitute a transport stream decoding sec- 
tion 110. 

[0006] To the TS header analyzing section 1 1 1 and 
the PES extracting section 112, TS packets under 
MPEG2 technique are sequentially inputted. Every time 
when a TS packet is inputted, the TS header analyzing 
section 1 1 1 analyzes the TS header of the TS packet. 
By referring to the analysis result of the TS header from 
theTS header analyzing section 1 1 1 , the PES extracting 



2 

section 1 1 2 extracts necessary PES data from the input- 
ted TS packet. Then, the PES extracting section 1 ^out- 
puts the extracted PES data to the PES buffer 1 1 3. The 
PES buffer 1 13 temporarily stores the PES data extract- 

s ed in the PES extracting section 112. The PES buffer 
controlling section 1 14outputsacontrolsignaltothe PES 
buffer 1 13 and performs an address control, an accumu- 
lated data control, and the like for the PES buffer 113. 
[0007] The MPEG decode section 120 reads out the 

10 PES data from the PES buffer 1 1 3 with an arbitrary tim- 
ing, executes a decode process, and outputs a decoded 
image and decoded audio. At this time, in orderto analyze 
the PES header necessary for the MPEG decode proc- 
ess, a start position of the PES data, namely, information 

'5 defining the PES data including the PES header be- 
comes necessary. Therefore, usually, by detecting a 
packet start code possessed byaPESheaderinthePES 
data stored in the PES buffer 113, the MPEG decode 
section 120 identifies a start position of the PES data. 

20 The technology relating to the identification of a start po- 
sition in PES data isdescribed, for example, in Japanese 
Laid-Open Patent Publication No. 2001-16547 (pages 6 
to 8, FIG. 1). 



[0008] However, in the case where the MPEG decode 
section 120 identifies a start position of PES data by de- 
tecting a packet start code in PES data extracted from 
30 TS packets, as in the aforementioned conventional 
MPEG decoding device 101 , there are problems as fol- 
lows. 

[0009] Firstly, a PES is variable in length. Therefore, 
in orderto identify a start position of PES data, it is nec- 

35 essary to perform a process of packet start code detec- 
tion for all of the PES data stored in the PES buffer 113. 
Note that a PES packet length contained in a PES header 
may possibly take the value "0"; even in this case, the 
actual length of the PES packet is not "0", and therefore 

40 it is necessary to detect the packet start code in order to 
identify the start position. Further, within an adaptation 
field and the PES header, a pattern which is identical to 
the packet start code, so-called a pseudo start code, may 
occur. For this reason, in orderto identify a correct start 

45 position of PES data while excluding a pseudo start code, 
a large amount of processing is necessary. 
[0010] Thus, there have been problems in that the 
processing load in the MPEG decode section 120 be- 
comes heavy, leading to a decrease in MPEG decode 

so processing speed and an increase in electric power con- 
sumption associated with an operation for identifying a 
start position in PES data. These problems are not only 
limited to TS packets under MPEG2 technique, but also 
relate to all packet transmissions in which variable length 

55 data is split into packets of an equal size. 

[0011] Thus, an object of the present invention is to 
provide a device and method of packet processing for, 
when decoding data of packets in which variable length 
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data is split and stored, by generating information which 
identifies a start position of data and providing it to a 
decoder, realizing a reduction in processing load at the 
decoder, improvement in decode processing speed, and 
decrease in electric power consumption. 
[0012] The present invention is directed to a packet 
processing device which processes packets in which var- 
iable length data is split and stored. In order to achieve 
the above-described object, the packet processing de- 
vice of the present invention comprises a header analyz- 
ing section, a data extracting section, a buffer, a buffer 
controlling section, and a start data identifying section. 
[001 3] The header analyzing section analyzes a head- 
er of a packet being inputted, and determines whether 
data stored in the payload is start data containing start 
information or other data. The data extracting section re- 
fers to the analysis result from the header analyzing sec- 
tion, and extracts the datafromthe payload of the packet. 
The buffer stores the data extracted by the data extracting 
section. The buffercontrolling section controls the stored 
position and the accumulated data amount of the data in 
the buffer. The start data identifying section generates 
information for identifying the start data in the buffer, 
based on the analysis result from the header analyzing 
section and the control by the buffer controlling section. 
[001 4] A typical start data identifying section is consti- 
tuted with a start position memory which retains stored 
position information of start data stored in the buffer and 
a number-of-starts counter which counts the number of 
start data stored in the buffer. Forthe start position mem- 
ory, a register which retains stored position information 
is conceivable. For stored position information, a write 
address of a buffer storing start data or information rep- 
resenting a position of start data relative to first data 
stored in a buffer is conceivable. 
[001 5] Moreover, the packet processing device of the 
present invention may further comprise a decode section 
which reads out datafrom the buffer with a predetermined 
timing, obtains stored position information and a count 
number from the start data identifying section, separates 
start data contained in the data read out based on the 
stored position information and the count number into 
start information and data, and performs a decode proc- 
ess for the data read out based on the start information. 
[0016] Here, it is preferable that the buffercontrolling 
section compares the accumulated data amount against 
a predetermined threshold amount, and, when the accu- 
mulated data amount becomes equal to or greater than 
the threshold amount, outputs a predetermined notifica- 
tion signal. When detecting this predetermined notifica- 
tion signal, it is preferable thatthe number-of-starts coun- 
ter displays the number of start data contained in an 
amount of data corresponding to the threshold amount. 
In the case where a decode section is comprised, an 
amount of data corresponding to the threshold amount 
is caused to be read out from the buffer at a timing with 
which a notification signal is received. 
[0017] Alternatively, it is preferable that the buffercon- 



trolling section compares the number in the number-of 
-starts counter against a predetermined threshold 
number, and, when the number becomes equal to or 
greater than the threshold number, outputs a predeter- 

s mined notification signal. The threshold number should 
only be the number of areas in a start position memory 
which enables retention of stored position information. 
In the case where a decode section is comprised, data 
is caused to be read out from the buffer with the timing 

10 of receiving a notification signal. 

[0018] Specifically.a transport stream packet under 
MPEG technique that stores variable-length PES data, 
is inputted. In this case, the header analyzing section 
analyzes the header of the TS packet in the transport 

'5 stream being inputted, and determines whether data 
stored in the payload is start PES data containing a PES 
header or other PES data; the packet data extracting 
section refers to the analysis result from the header an- 
alyzing section, and extracts PES datafrom the payload 

20 of theTS packet; the bufferstoresthe PES data extracted 
by the packet data extracting section; the buffer control- 
ling section controls the stored position and the accumu- 
lated data amount of the PES data in the buffer; and the 
start data identifying section generates information for 
identifying the start PES data in the buffer, based on the 
analysis result from the header analyzing section and the 
control by the buffer controlling section. 
[0019] Each process which is conducted by each con- 
stituent of the aforementioned packet processing device 

30 can be taken as a packet processing method and a de- 
code processing method which define a series of 
processing procedures. In other words, it is a packet 
processing method for analyzing a header of a packet 
being inputted, determining whether data stored in the 

35 payload is start data containing start information or other 
data, referring to the analysis result to extract the data 
from the payload of the packet, storing the data extracted 
to the buffer, controlling the stored position of the data 
and the accumulated data amount in the buffer, and gen- 

40 erating information for identifying the start data in the 
buffer based on the analysis result and the control. Al- 
ternatively, it is a decode processing method for reading 
out data from the buffer with a predetermined timing, sep- 
arating start data contained in the data read out into start 

45 information and data based on information for identifying 
start data, and performing a decode process for the data 
read out based on the start information. 
[0020] Functional blocks constituting the aforemen- 
tioned packet processing device can be realized as an 

so LSI, which is an integrated circuit. Further, the packet 
processing method is provided in the form of a program 
for a computer to execute a series of processing steps. 
This program may be introduced into a computer in the 
form of being recorded in a recording medium readable 

55 by the computer. 

[0021] As described above, according to the present 
invention, when data stored in a buffer is read out for 
decoding, information for identifying start data can be 
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obtained. Therefore, there is no need for detecting a start 
position at a decoding side, and a reduction in decode 
processing load, improvement in decode processing 
speed, and decrease in electric power consumption can 
be realized. Moreover, by ensuringthatthe decoding side 
performs a data read process only when a notification 
signal that the accumulated data amount in the buffer 
has reached a threshold amount is received, the decode 
process can be lightened. Furthermore, by ensuring that 
the decoding side reads out the data automatically when 
a predetermined number of start data has been stored 
to the buffer, the circuit scale of the start position memory 
can be prevented from increasing even in the case where 
there is a possibility that a large number of start data may 
be stored in the buffer due to, for example, data of short 
length being successively inputted. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0022] 

FIG. 1 is a block diagram illustrating a construction 
of a packet processing device 1 according to an em- 
bodiment of the present invention. 
FIG. 2 is a flowchart illustrating an exemplary basic 
data processing procedure which a data processing 
section 10 performs. 

FIG. 3 is a diagram illustrating exemplary packets 
which are inputted to the packet processing device 1 . 
FIG. 4Ato FIG. 4Fare diagrams describing states of 
a buffer 13, a start position memory 15, and a 
number-of-starts counter 16, in accordance with the 
packet in FIG. 3. 

FIG. 5A is a flowchart illustrating an exemplary read 
processing procedure for data which a decode sec- 
tion 20 performs (first technique). 
FIG. 5B is a diagram illustrating an exemplary 
processing sequence according to the procedure in 
FIG. 5A. 

FIG. 6A is a flowchart illustrating an exemplary pro- 
cedure for data read processing which the decode 
section 20 performs (second technique). 
FIG. 6B is a diagram illustrating an exemplary 
processing sequence according to the procedure in 
FIG. 6A. 

FIG. 7A is a flowchart illustrating an exemplary pro- 
cedure for data read processing which the decode 
section 20 performs (third technique). 
FIG. 7B is a diagram illustrating an exemplary 
processing sequence according to the procedure in 
FIG. 7A. 

FIG. 8A is a flowchart illustrating an exemplary pro- 
cedure for data read processing which the decode 
section 20 performs (fourth technique). 
FIG. 8B is a diagram illustrating an exemplary 
processing sequence according to the procedure in 
FIG. 8A. 

FIG. 9A is a flowchart illustrating an exemplary pro- 



cedure for data read processing which the decode 
section 20 performs (fifth technique). 
FIG. 9B is a diagram illustrating an exemplary 
processing sequence according to the procedure in 

5 FIG. 9A. 

FIG. 1 0A is a flowchart illustrating an exemplary pro- 
cedure for data read processing which the decode 
section 20 performs (sixth technique). 
FIG. 10B is a diagram illustrating an exemplary 

10 processing sequence according to the procedure in 
FIG. 10A. 

FIG. 1 1 is a diagram illustrating exemplary TS pack- 
ets to be inputted to the packet processing device 1 . 
FIG. 12Ato FIG. 12F are diagrams describing states 

'5 of the buffer 13, the start position memory 15, and 
the number-of-starts counter 1 6, in accordance with 
theTS packets in FIG. 11. 
FIG. 13 is a diagram illustrating an exemplary con- 
struction of the start position memory 1 5, in the case 

20 where only data is stored to the buffer 1 3. 

FIG. 14A is a diagram illustrating an exemplary 
processing sequence, in the case of employing both 
FIG. 7A (third technique) and FIG. 9A, the fifth tech- 
nique. 

25 FIG. 14B is a diagram illustrating an exemplary 
processing sequence, in the case of employing both 
FIG. 8A (fourth technique) and FIG. 10A, the sixth 
technique. 

FIG. 15 is a diagram illustrating a detailed structure 
30 of a PES packet. 

FIG. 16 is a diagram illustrating a detailed structure 
of a TS packet. 

FIG. 1 7 is a diagram illustrating the relationship be- 
tween TS packets and PES data. 
35 FIG. 18 is a block diagram illustrating a construction 
of a conventional MPGE decoding device 101. 

BEST MODE FOR CARRYING OUT THE INVENTION 

40 [0023] Hereinafter, with respect to an exemplary case 
where packets in which variable length data is split and 
stored is inputted as an example, a packet processing 
device of the present invention will be described. 
[0024] FIG. 1 is a block diagram illustrating the con- 
45 struction of a packet processing device 1 according to 
an embodiment of the present invention. In FIG. 1 , the 
packet processing device 1 comprises a header analyz- 
ing section 1 1 , a data extracting section 1 2, a buffer 1 3, 
a buffer controlling section 14, a start data identifying 
so section 17, and a decode section 20. The header ana- 
lyzing section 1 1 , the data extracting section 1 2, the buff- 
er 1 3, the buffer controlling section 1 4, and the start data 
identifying section 1 7 constitute a data processing sec- 
tion 1 0. A typical start data identifying section 1 7 is com- 
55 posed of a start position memory 15 and a 
number-of-starts counter 16. Note that the present em- 
bodiment illustrates the construction where the decode 
section 20 is being incorporated into the packet process- 
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ing device 1 ; however, this decode section 20 may be 
constructed independently of the packet processing de- 
vice 1 . 

[0025] Tothe headeranalyzingsection 1 1 andthedata 
extracting section 12, packets in which variable length 
data is split and stored are sequentially inputted. Every 
time when a packet is inputted, the header analyzing sec- 
tion 1 1 analyzestheheaderofthe packet and determines 
whether the data stored in the payload is start data con- 
taining start information or other data (non-start data). 
Here, the start information is header information and the 
like in which time information and the like necessary for 
a decode process are written. The data extracting section 
12 refers to the analysis result of the header from the 
header analyzing section 1 1 , and extracts necessary da- 
ta from the payload of the packet inputted. Then, the data 
extracting section 12 outputs the extracteddata to the 
buffer 13 and, if start data has been outputted, notifies 
so to the buffer controlling section 14. The buffer 13 
stores the data outputted from the data extracting section 
12 in a predetermined position, in accordance with the 
stored position control by the buffer controlling section 
14. 

[0026] The buffer controlling section 14 performs the 
stored position control and the accumulated data control 
for the buffer 13. This stored position control means the 
controlling of a position (write address) at which to write 
the data extracted by the data extracting section 12, and 
is typically performed by employing a write pointer (WP). 
The accumulated data control means performing a con- 
trol so that the data extracted by the data extracting sec- 
tion 1 2 is stored to the buffer 1 3 without overflowing, and 
is typically the management of the accumulated data 
amount of data stored in the buffer 13. Further, when 
being notified from the data extracting section 12 that 
start data has been stored in the buffer 13, the buffer 
controlling section 14 notifies the start position memory 
15 of the stored position information, and notifies the 
number-of -starts counter 1 6 of the storing. 
[0027] The start position memory 15 retains the write 
address of the start data on the buffer 1 3 which is notified 
by the buffer controlling section 14, as the stored position 
information of the start data. This start position memory 
1 5 is a register having a plurality of register areas therein, 
a memory having a plurality of storage areas therein, or 
the like. If it is a memory, the number to be stored can 
be easily changed. Note that the memory is to be con- 
structed independently of the buffer 13. The 
number-of-starts counter 16 counts the number of start 
data having been written in the buffer 13. Specifically, 
when start data is stored in the buffer 1 3, i.e., when being 
notified from the buffer controlling section 14, the count 
number in the number-of-starts counter 16 is increment- 
ed. Note that this count number in the number-of-starts 
counter 1 6 is reset when the start data corresponding to 
the count number has been read out from the buffer 13 
by the decode section 20, i.e., when the start position 
memory 15 is referred to. 



[0028] Next, with reference to FIG. 2, the process per- 
formed by the data processing section 1 0 will be de- 
scribed in detail. FIG. 2 is a flowchart illustrating an ex- 
emplary basic data processing procedure performed by 

s the data processing section 1 0. 

[0029] The data extracted by the data extracting sec- 
tion 12 is stored at an address position in the buffer 13 
as designated by the write pointer (step S21 , S22). If the 
stored data is not start data (step S23, No), the write 

10 pointer in the buffer 13 is moved to the next address 
position by the buffer controlling section 14 (step S26). 
On the other hand, if the data stored is start data (step 
S23, Yes), the address of the position at which the start 
data is stored is saved to the start position memory 15 

'5 by the buffer controlling section 14 (step S24). Further, 
the count number in the number-of-starts counter 16 is 
incremented by the buffer controlling section 14 (step 
S25). Thereafter, the write pointer in the buffer 13 is 
moved to the next address position by the buffer control- 

20 ling section 14 (step S26). 

[0030] The processes above are executed with re- 
spect to each packet inputted (step S27). Thus, the data 
processing section 1 0 causes the start position memory 
1 5 andthe number-of-starts counter 16 to store the stored 
position information of the start data written in the buffer 
13 and the number thereof, respectively. 
[0031] Next, with reference to FIG. 3 and FIG. 4A to 
FIG. 4F, the relationship between the data stored in the 
buffer 13, the stored position information retained in the 

30 start position memory 15, and the count number in the 
number-of-starts counter 16 will be specifically de- 
scribed. FIG. 3 is a diagram illustrating exemplary pack- 
ets which are inputted to the packet processing device 
1. FIG. 4A to FIG. 4F are diagrams describing states of 

35 the buffer 13, the start position memory 15, and the 
number-of-starts counter 16, in accordance with the 
packet in FIG. 3. Here, a case will be described where 
the packets shown in FIG. 3 are inputted when the states 
of the buffer 13, the start position memory 15, and the 

40 number-of-starts counter 16 are as shown in FIG. 4A. 
[0032] Data (1 ), which is extracted first, is stored to the 
address "0001 ", as designated by the write pointer in the 
buffer 1 3. Because data (1 ) is not start data, only a moving 
of the write pointer to the address "0002" is conducted 

45 (the state in FIG. 4B) . 

[0033] Data (2), which is next extracted, is stored in 
the address "0002", as designated by the write pointer 
in the buffer 13. Because data (2) is start data, the ad- 
dress "0002" is retained in the start position memory 1 5, 

so and the count number in the number-of-starts counter 1 6 
is updated from "0" to "1" . Thereafter, the write pointer 
moves to the position of the address "0003" (the state in 
FIG. 4C). 

[0034] Likewise, next-extracted data (3) and data (4), 
55 which are not start data, are stored in the addresses 
"0003" and "0004", respectively, according to the write 
pointer in the buffer 1 3. The write pointer is moved to the 
position of the address "0005", through this process (the 



2/11/2009, EAST Version: 2.3.0.3 



EP 1 641 127 A1 



10 



state in FIG. 4D). 

[0035] Furthermore, next-extracted data (5), which is 
start data, is stored in the address "0005", as designated 
by the write pointer in the buffer 13. Then, the address 
"0005" is additionally retained in the start position mem- 
ory 15, and the count number in the number-of-starts 
counter 1 6 is updated from "1 " to "2". Thereafter, the write 
pointer moves to the position of the address "0006" (the 
state in FIG. 4E). 

[0036] Next-extracted data (6), which is not start data, 
is stored in the address "0006", according to the write 
pointer in the buffer 13. The write pointer moves to the 
position of the address "0007" (the state in FIG. 4F). 
[0037] Next, the operation that the decode section 20 
performs will be described. With a predetermined timing, 
the decode section 20 refers to the start position memory 
15 and the number-of-starts counter 16, and reads out 
the data from the buffer 1 3. Then, the decode section 20 
performs a decode process for the data read out, and 
outputs images and audio. In the decode section 20, the 
following six techniques are conceivable for the data read 
process to be performed. 

1 . first technique (FIG. 5A, FIG. 5B) 

[0038] The first technique is a technique in which the 
decode section 20 executes a decode process with an 
arbitrary timing. First, when the timing for the process 
comes, the decode section 20 refers to the count number 
in the number-of-starts counter 1 6 (step S51 , S52). Next, 
the decode section 20 determines whether the count 
number is equal to or greater than "1 " or not (step S53). 
If the count number is equal to or greater than "1 ", the 
decode section 20 obtains a number, equal to the count 
number, of addresses that are stored in the start position 
memory 15 (step S54). 

[0039] For example, in the case where a decode proc- 
ess is executed in the state of FIG. 4F, the decode section 
20 refers to the count number "2" in the number-of-starts 
counter 1 6. Then, the decode section 20 obtains the two 
addresses priorto the latest information, i.e., "0002" and 
"0005", from the start position memory 15. 
[0040] Next, the decode section 20 sequentially reads 
outthe data stored in the buffer 13 from, for example, an 
address position designated by a read pointer (step S55). 
As for the start data which is read out from the address 
position that corresponds to the stored position informa- 
tion obtained from the start position memory 15, the de- 
code section 20 separates it into a header and data, and 
performs a decode process of the data based on the 
header. This process can be performed by utilizing var- 
ious time information which is contained in the header 
and necessary for the decode process. 
[0041] Through repeatedly performing the above pro- 
cedures until the decode process ends (step S56), the 
decode section 20 can perform the decode process of 
the data read out from the buffer 13, without newly per- 
forming a start position detection of the data. Note that 



FIG. 5B is a diagram illustrating an exemplary processing 
sequence according to the procedure in FIG. 5A. 

2. second technique (FIG. 6A, FIG. 6B) 

[0042] The second technique is a variation of the first 
technique with respect to its procedure. In the second 
technique, when the timing for a process comes, first, 
the decode section 20 sequentially reads out the data 

10 stored in the buffer 13 from, for example, the address 
position designated by the read pointer (step S51 , S55) . 
Then, when the reading out of the data is completed, 
reference to the count number in the number-of-starts 
counter 16, determination, and obtainment of the address 

'5 stored in the start position memory 15 are performed 
(step S52 to S54). 

[0043] Through repeatedly performing the above pro- 
cedures until the decode process ends (step S56), the 
decode section 20 can perform the decode process of 
20 the data read out from the buffer 1 3, without newly per- 
forming a start position detection of the data. Note that 
FIG. 6B is a diagram illustrating an exemplary processing 
sequence according to the procedure in FIG. 6A. 

25 3. third technique (FIG. 7A, 7B) 

[0044] The third technique is a technique in which the 
decode section 20 executes a decode process according 
to a notification signal from the data processing section 

30 1 0. In this technique, a predetermined threshold amount 
for the accumulated data amount in the buffer 13 is pre- 
viously retained in the buffer controlling section 14. The 
threshold amount is set to a value equal to or less than 
the maximum accumulated data amount in the buffer 1 3 

35 (for example, 80% of the maximum accumulated data 
amount) . Then, the buffer controlling section 14 is 
caused to monitor the buffer 1 3 at all times and, when it 
is determined that the accumulated data amount has 
reached the threshold amount, output a notification signal 

40 to the start position memory 15 and to the 
number-of-starts counter 16. When receiving the notifi- 
cation signal, the start position memory 15 defines the 
addresses retained by that point of time as the stored 
position information to be provided to the decode section 

45 20. Further, when receiving the notification signal, the 
number-of-starts counter 16 defines the count number 
bythat point of time, namely, the number ofthe start data 
contained in an amount of data corresponding to the 
threshold amount, as the number information to be pro- 

50 vided to the decode section 20. Furthermore, this notifi- 
cation signal is outputted to the decode section 20, 
through the start position memory 15 or the 
number-of-starts counter 16. 

[0045] First, when receiving a notification signal that 
55 the accumulated data amount has reached the threshold 
amount, the decode section 20 refers to the count number 
defined by the number-of-starts counter 16 (step S71, 
S72). Next, the decode section 20 determines whether 
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the count number is equal to or greater than "1 " or not 
(step S73). If the count number is equal to or greaterthan 
"1", the decode section 20 obtains an amount of the 
stored position information defined by the start position 
memory 15 that corresponds to the count number (step 
S74) . Thus, as for the start data which is stored in the 
buffer 13 after the aforementioned notification signal, no 
information will be provided to the decode section 20. 
Then, the decode section 20 sequentially reads out the 
data stored in the buffer 1 3 from, for example, an address 
position designated by the read pointer (step S75). As 
for the start data which is read out from the address po- 
sition that corresponds to the stored position information 
obtained from the start position memory 15, the decode 
section 20 separates it into a header and data, and per- 
forms a decode process of the data based on the header. 
[0046] Note that, when the decode section 20 has read 
out the stored position information in the start position 
memory 15, the number-of-starts counter 16 resets the 
count number having been defined, and displays the 
count of the number of start data stored in the buffer 13 
at that point of time. 

[0047] Through repeatedly performing the procedures 
above until the decode process ends (step S76), the de- 
code section 20 can perform the decode process of the 
data read out from the buffer 1 3, without newly performing 
a start position detection of the data. Moreover, the de- 
code section 20 only needs to perform the data read proc- 
ess when receiving a notification signal that the accumu- 
lated data amount in the buffer 1 3 has reachedthethresh- 
old amount; thus, the decode process can be lightened. 
Note that FIG. 7B is an exemplary processing sequence 
according to the procedure in FIG. 7A. 

4. fourth technique (FIG. 8A, FIG. 8B) 

[0048] The fourth technique is a variation of the third 
technique with respectto its procedure. Inthefourth tech- 
nique, when the timing for a process comes, first, the 
decode section 20 sequentially reads out the data stored 
in the buffer 13 from, for example, an address position 
designated by the read pointer (step S71, S75) . Then, 
when the reading out of the data is completed, reference 
to the count number in the number-of-starts counter 16, 
determination, and obtainment of the address stored in 
the start position memory 1 5 are performed (step S72 to 
S74). 

[0049] Through repeatedly performing the above pro- 
cedures until the decode process ends ( step S76) , the 
decode section 20 can perform the decode process of 
the data read out from the buffer 13, without newly per- 
forming a start position detection of the data. Note that 
FIG. 8B is a diagram illustrating an exemplary processing 
sequence according to the procedure in FIG. 8A. 

5. fifth technique (FIG. 9A, FIG. 9B) 

[0050] The fifth technique is also a technique in which 
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the decode section 20 executes a decode process ac- 
cording to a notification signal from the data processing 
section 10. In this technique, a predetermined threshold 
numberth at corresponds to the number of stored position 

s information retainable in the start position memory 15 is 
previously retained in the number-of-starts counter 16. 
In other words, this threshold number is set according to 
the number of the storing areas that the start position 
memory 1 5 comprises. Then, when the number-of-starts 

'o counter 16 determines that the count number has 
reached the threshold number, the decode section 20 is 
so notified. 

[0051 ] First, when receiving the notification signal that 
the count number has reached the threshold number, the 

'5 decode section 20 refers to the count number in the 
number-of-starts counter 16 (step S91, S92). Next, the 
decode section 20 obtains an amount of the stored po- 
sition information stored in the start position memory 15 
that corresponds to the count number (step S93). Then, 

20 the decode section 20 sequentially reads out the data 
stored in the buffer 13 from, for example, an address 
position designated by the read pointer (step S94) . As 
for the start data which is read out from the address po- 
sition that corresponds to the stored position information 

25 obtained from the start position memory 15, the decode 
section 20 separates it into a header and data, and per- 
forms a decode process of the data based on the header. 
[0052] Through repeatedly performing the procedures 
above until the decode process ends (step S95), the de- 

30 code section 20 can perform the decode process of the 
data read out from the buffer 1 3, without newly performing 
a start position detection of the data . Moreover, because 
the decode section 20 reads out the data automatically 
when a predetermined number of start data has been 

35 stored in the buffer 1 3, the circuitscale of the start position 
memory 15 can be prevented form increasing even in 
the case where there is a possibility that a number of 
start data may be stored in the buffer 13 due to, for ex- 
ample, data of short length being successively inputted. 

40 Note that FIG. 9B is a diagram illustrating an exemplary 
processing sequence according to FIG. 9A. 

6. sixth technique (FIG. 10A, FIG. 10B) 

45 [0053] The sixth technique is a variation of the fifth 
technique with respect to its procedure. In the sixth tech- 
nique, when the timing for a process comes, first, the 
decode section 20 sequentially reads out the data stored 
in the buffer 13 from, for example, an address position 

so designated by the read pointer (step S91, S94). Then, 
when the reading out of the data is completed, reference 
to the count number in the number-of-starts counter 16 
and obtainment of the address stored in the start position 
memory 15 are performed (step S92, S93). 

55 [0054] Through performingthe above procedures until 
the decode process ends (step S95), the decode section 
20 can perform the decode process of the data read out 
from the buffer 13, without newly performing a start po- 
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sition detection of the data. Note that FIG. 1 0B is a dia- 
gram illustrating an exemplary processing sequence ac- 
cording to the procedure in FIG. 1 0A. 
[0055] As described above, through the device and 
method of packet processing according to an embodi- 
ment of the present invention, when the decode section 
20 reads out data stored in the buffer 13, information 
concerning a stored position and the number of start data 
can be obtained independently of the reading out of the 
data. Therefore, there is no need for detecting a start 
position at the side of the decode section 20, and a re- 
duction in decode processing load, improvement in de- 
code processing speed, and decrease in electric power 
consumption can be realized. 

(an exemplary application of MPEG2 technique to TS 
packets) 

[0056] Next, an exemplary embodiment in which the 
packet processing device 1 of the present invention is 
applied to a decode process of TS packets under MPEG2 
technique will be described. It is assumed that synchro- 
nization of TS packets being inputted to the data process- 
ing section 1 0 has been established through detection 
of a synchronization byte (refer to FIG. 16) in the TS 
header or the like. 

[0057] Tothe headeranalyzingsection 1 1 andthedata 
extracting section 12, TS packets under MPEG2 tech- 
nique are sequentially inputted. Every time a TS packet 
is inputted, the header analyzing section 11 analyzes 
header information, namely, aTS headerof the TS pack- 
et. At this time, if a payload unit starting indicator (refer 
to FIG. 1 6) is "1 ", the header analyzing section 1 1 deter- 
mines that PES data containing a PES header (herein- 
after referred to as start PES data) is stored in the payload 
of the TS packet inputted. The data extracting section 12 
refers to the analysis result of the TS header from the 
headeranalyzingsection 1 1 and extracts necessary PES 
data from the TS packet inputted. Then, the data extract - 
ingsection 12 outputs the extracted PES data to the buff- 
er 13 and, if start PES data is outputted, notifies so to 
the buffer controlling section 1 4. The buffer 1 3 stores the 
PES data outputted from the data extracting section 12 
to a predetermined position, according to the stored po- 
sition control by the buffer controlling section 14. 
[0058] The start position memory 15 retains the write 
address of the start data on the buffer 1 3 which is notified 
by the buffer controlling section 14, as the stored position 
information of the start data. The number-of-starts coun- 
ter 1 6 counts the number of start PES data having been 
written in the buffer 13. Specifically, when the start PES 
data is stored in the buffer 13, i. e. , when being notified 
from the buffer controlling section 1 4, the count number 
in the number-of-starts counter 16 is incremented. Note 
that the count number in the number-of-starts counter 16 
is reset when the start PES data corresponding to the 
count number has been read out from the buffer 13 by 
the decode section 20, i.e., when the start position mem- 
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ory 1 5 is referred to. 

[0059] FIG. 1 1 is a diagram illustrating exemplary TS 
packets to be inputted to the packet processing device 
1. FIG. 12Ato FIG. 12F are diagrams describing states 

s of the buffer 13, the start position memory 15, and the 
number-of-starts counter 16, in accordance with the TS 
packets in FIG. 1 1 . Here, a case will be described where 
the TS packets shown in FIG. 1 1 are inputted when the 
states of the buffer 1 3, the start position memory 1 5, and 

'0 the number-of-starts counter 16 are as shown in FIG. 
12A. 

[0060] PES data (1 ), which is extracted first, is stored 
to the address "0001 ", as designated by the write pointer 
in the buffer 13. Because PES data (1) is not start PES 
'5 data, only a moving of the write pointer to the address 
"0002" is conducted (the state in FIG. 12B). Note that an 
elementary streamof PES data is denoted as "ES" in fig- 
ures. 

[0061] PES data (2), which is next extracted, is stored 
20 in the address "0002", as designated by the write pointer 
in the buffer 13. Because PES data (2) is start PES data, 
the address "0002" is retained in the start position mem- 
ory 15, and the count number in the number-of-starts 
cou nter 1 6 is updated from "0" to " 1 ". Thereafter, the write 
pointer moves to the position of the address "0003" (the 
state in FIG. 12C). Note that a PES header in PES data 
is denoted as "H" in figures. 

[0062] Likewise, next-extracted PES data (3) and PES 
data (4), which are not start PES data, are stored in the 
30 addresses "0003" and "0004", respectively, according to 
the write pointer in the buffer 13. The write pointer is 
moved to the position of the address "0005", through this 
process (the state in FIG. 12D). 

[0063] Furthermore ; next-extracted PES data (5), 
as which is start PES data, is stored in the address "0005", 
as designated by the write pointer in the buffer 1 3. Then, 
the address "0005" is additionally retained in the start 
position memory 15, and the count number in the 
number-of-starts counter 16 is updated from "1" to "2". 
*> Thereafter, the write pointer moves to the position of the 
address "0006" (the state in FIG. 12E). 
[0064] Then, next-extracted PES data (6), which is not 
start PES data, is stored in the address "0006", according 
to the write pointer in the buffer 13. The write pointer 
45 moves to the position of the address "0007" (the state in 
FIG. 12F). 

[0065] The operations which the decode section 20 
performs are as in the aforementioned techniques, first 
to sixth. Note that the decode process of the elementary 

so stream which is based on the PES header separated 
from the start PES data can be performed by utilizing 
various information (refer to FIG. 15) necessary for a 
MPEG decode process, such as time information (PTS: 
Presentation Time Stamp and DTS : Decode Time 

55 Stamp) and the like that are contained in a PES header. 
[0066] As described above, the device and method of 
packet processing of the present invention can be applied 
to TS packets under MPEG2 technique. 
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[0067] Note that the aforementioned embodiment de- 
scribes the case where an address position in the buffer 
1 3 in which start data is stored is used as stored position 
information; however, information (byte number and the 
like) which represents a position of start data relative to 
the first data stored in the buffer can also be used. 
[0068] Further, the aforementioned embodiment de- 
scribes the case where a position in the buffer 13 in which 
start data is stored is identified by using the start data 
identifying section 17, which is composed of the start 
position memory 1 5 and the number-of -starts counter 1 6. 
However, the present invention is not limited to the con- 
struction using a memory and a counter. As long as it is 
a construction which can identify a stored position of start 
data in the buffer 13, a start data identifying section of 
any other construction may be used. 
[0069] Furthermore, the aforementioned embodiment 
describes the case where both a header and data are 
stored in the buffer 13; however, only data may be stored. 
In the case of MPEG2 technique, "ES" is data. However, 
in this case, time information (time stamps T1 , T2... and 
so on) which is usually contained in a header and nec- 
essary for a decode process needs to be stored in the 
start position memory 15, in association with start data, 
for example. FIG. 13 is a diagram illustrating an example 
in which this technique is applied to the state as in FIG. 
12F. 

[0070] Furthermore, in the decode section 20 accord- 
ing to the aforementioned embodiment is illustrated as 
using eitherthe third (fourth) technique orthe fifth (sixth) 
technique; however, both of these techniques may be 
used simultaneously. FIG. 14A and FIG. 14B are, dia- 
grams illustrating an exemplary processing sequence ac- 
cording to both procedures. 

[0071] Note that among the functional blocks of the 
packet processing device according to the present inven- 
tion, the header analyzing section 11, data extracting 
section 12, buffer controlling section 14, and the start 
data identifying section 17 may typically be realized as 
an LSI, which is an integrated circuit (which may be re- 
ferred to as an IC, a system LSI, a super LSI, or an ultra 
LSI, etc. , depending on the degree of integration) . Each 
functional block may be separately constructed in a chip 
form, or all or some of the functional blocks may be con- 
structed in a chip form. 

[0072] Also, the method of integration is not limited to 
LSI, and maybe realized by a dedicated circuit or a gen- 
eral purpose processor. Also, an FPGA (Field Program- 
mable Gate Array), which is an LSI that can be pro- 
grammed after manufacture, or a reconfigurable proces- 
sor enabling connections and settings of the circuit cells 
in the LSI to be reconfigured may be used. 
[0073] Further, in the case where another integration 
technology replacing LSI becomes available due to im- 
provement of a semiconductor technology or due to the 
emergence of another technology derived therefrom, in- 
tegration of the functional blocks may be performed using 
such a new integration technology. For example, biotech- 
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nology may be applied to the above-described integra- 
tion. 

[0074] Also note that the packet processing method 
according to the present invention can be realized by a 

s CPU interpreting and executing program data, which is 
able to cause a CPU to execute the above-described 
processing steps, stored in a storage device (e.g., a 
ROM, a RAM, or a hard disk) . In this case, the program 
data may be introduced into the storage device from a 

10 recording medium such as a CD-ROM or a flexible disk, 
or may be directly executed from the recording medium. 

INDUSTRIAL APPLICABILITY 

15 [0075] A device and method of packet processing ac- 
cording to the present invention can be used in the case 
of decoding data of packets in which variable length data 
is split and stored and the like; particularly, they are ef- 
fective in cases where a reduction in processing load at 

20 a decoder, improvement in decode processing speed, 
and decrease in electric power consumption are to be 
realized, for example. 



-?5 Claims 

1. A packet processing device for processing packets 
in which variable length data is split and stored, com- 
prising: 

30 

a header analyzing section for analyzing a head- 
er of an inputted packet and determining wheth- 
er data stored in a payload is start data contain- 
ing start information or other data; 
35 a data extracting section for referring to an anal- 

ysis result from the header analyzing section, 
and extracting the data from the payload of the 
packet; 

a bufferfor storing the data extracted by the data 

40 extracting section; 

a buffer controlling section for controlling a 
stored position and an accumulated data 
amount of the data in the buffer; and 
a start data identifying section for generating in- 

45 formation for identifying the start data in the buff- 

er, based on the analysis result from the header 
analyzing section and the control by the buffer 
controlling section. 

so 2. The packet processing device according to claim 1 , 
wherein the start data identifying section comprises: 

a start position memory for retaining stored po- 
sition information of the start data stored in the 
55 buffer; and 

a number-of-starts counter for counting a 
number of the start data stored in the buffer. 



EP 1 641 127 A1 



9 



2/11/2009, EAST Version: 2.3.0.3 



17 

3. The packet processing device according to claim 2, 
wherein the start position memory is a register for 
retaining the stored position information. 

4. The packet processing device according to claim 2, s 
wherein the start position memory is a memory, con- 
structed independently of the buffer, for retaining the 
stored position information. 

5. The packet processing device according to claim 2, »o 
wherein the stored position information is a write ad- 
dress in the buffer storing the start data. 

6. The packet processing device according to claim 2, 
wherein the stored position information is informa- '5 
tion representing a position of the start data relative 

to first data stored in the buffer. 

7. The packet processing device according to any of 
claims 2 to 6, 20 
wherein the buffer controlling section compares the 
accumulated data amount against a predetermined 
threshold amount and, when the accumulated data 
amount becomes equal to or greaterthan the thresh- 
old amount, outputs a predetermined notification sig- 25 
nal. 

8. The packet processing device according to claim 7, 
wherein, when detecting the predetermined notifica- 
tion signal, the number-of-starts counter displays a 30 
number of the start data contained in an amount of 
data corresponding to the threshold amount. 

9. The packet processing device according to any of 
claims 2 to 6, 35 
wherein the buffer controlling section compares the 
number in the number-of-starts counter against a 
predetermined threshold number and, when the 
number becomes equal to or greaterthan the thresh- 
old number, outputs a predetermined notification sig- to 
nal. 

10. The packet processing device according to claim 7, 
wherein the threshold number is a number of areas 

in the start position memory which enables retention t5 
of the stored position information. 

11. The packet processing device according to any of 
claims 2 to 1 0 further comprising: 

50 

a decode section for reading out data from the 
buffer with a predetermined timing, obtaining 
stored position information and a count number 
from the start data identifying section, separat- 
ing the start data contained in the data read out 55 
based on the stored position information and the 
count number into start information and data, 
and performing a decode process for the data 



18 

read out based on the start information. 

12. The packet processing device according to claim 1 1 , 
wherein the buffer controlling section compares the 
accumulated data amount against a predetermined 
threshold amount, and, when the accumulated data 
amount becomes equal to or greaterthan the thresh- 
old amount, outputs a predetermined notification sig- 

wherein, when detecting the predetermined notifica- 
tion signal, the number-of-starts counter displays a 
number of the start data contained in an amount of 
data corresponding to the threshold amount, and 
wherein the decode section reads out an amount of 
data corresponding to the threshold amount from the 
buffer at a timing of receiving the notification signal. 

13. The packet processing device according to claim 1 1 , 
wherein the buffer controlling section compares the 
number in the number-of-starts counter against a 
predetermined threshold number, and, when the 
number becomes equal to orgreaterthan the thresh- 
old number, outputs a predetermined notification sig- 
nal, and 

wherein the decode section reads out the data from 
the buffer at a timing of receiving the notification sig- 
nal. 

14. The packet processing device according to claim 1 , 
wherein, when a transport stream packet under 
MPEG technique that stores variable-length PES da- 
ta is inputted, 

the header analyzing section analyzes a header of 
a TS packet in the inputted transport stream, and 
determines whether data stored in a payload is start 
PES data containing a PES header or other PES 
data, 

the data extracting section refers to an analysis result 
from the header analyzing section, and extracts PES 
data from the payload of the TS packet, 
the buffer stores the PES data extracted by the data 
extracting section, 

the buffer controlling section controls a stored posi- 
tion and an accumulated data amount of the PES 
data in the buffer, and 

the start data identifying section generates informa- 
tion for identifying the start PES data in the buffer, 
based on the analysis result from the header ana- 
lyzing section and the control by the buffercontrolling 
section. 

15. A packet processing method for processing packets 
in which variable length data is split and stored, com- 
prising: 

an analysis step of analyzing a header of an in- 
putted packet, and determines whether data 
stored in a payload is start data containing start 
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information or other data; 
an extracting step of referring to an analysis re- 
sult from the analyzing step, and extracting the 
data from the payload of the packet; 
a step of storing the data extracted in the ex- s 
trading step to a buffer; 
a control step of controlling a stored position and 
an accumulated data amount of the data in the 
buffer; and 

an identifying step of generating information for io 
identifying the start data in the buffer, based on 
the analysis result from the analyzing step and 
the control from the control step. 

16. A decode processing method for decoding data '5 
stored in a buffer by using information for identifying 
start data containing start information that is included 

in data stored in the buffer, comprising: 

a reading-out step of reading out data from the 20 
buffer with a predetermined timing; 
a separating step of separating the start data 
contained in the data read out into start informa- 
tion and data based on information for identifying 
the start data; and 25 
a decoding step of performing a decode process 
forthe data read out based on the start informa- 
tion. 

17. A computer readable program for a computer to ex- 30 
ecute a packet processing method for processing 
packets in which variable length data is split and 
stored, 

wherein the program causes a computer to execute: 

35 

an analysis step of analyzing a header of an in- 
putted packet, and determines whether data 
stored in a payload is start data containing start 
information or other data; 

an extracting step of referring to an analysis re- «> 
suit from the analyzing step, and extracting the 
data from the payload of the packet; 
a step of storing the data extracted in the ex- 
tracting step to a buffer; 

a control step of controlling a stored position and 45 
an accumulated data amount of the data in the 
buffer; and 

an identifying step of generating information for 
identifying the start data in the buffer, based on 
the analysis result from the analyzing step and so 
the control from the control step. 

1 8. A computer readable program for a computer to ex- 
ecute a decode processing method for decoding da- 
ta stored in a buffer by using information for identi- 55 
tying start data containing start information that is 
included in data stored in the buffer, 

wherein the program causes the computer to exe- 



cute: 

a reading-out step of reading out data from the 
buffer with a predetermined timing; 
a separating step of separating the start data 
contained in the data read out into start informa- 
tion and data based on information for identifying 
the start data; and 

a decoding step of performing a decode process 
for the data read out based on the start informa- 
tion. 

19. A medium having recorded thereon a computer read- 
able program for a computer to execute a packet 
processing method for processing packets in which 
variable length data is split and stored, 

wherein the program recorded in the medium causes 
the computer to execute: 

an analysis step of analyzing a header of an in- 
putted packet, and determining whether data 
stored in a payload is start data containing start 
information or other data; 
an extracting step of referring to an analysis re- 
sult from the analyzing step, and extracting the 
data from the payload of the packet; 
a step of storing the data extracted in the ex- 
tracting step to a buffer; 
acontrol step of controlling a stored position and 
an accumulated data amount of the data in the 
buffer; and 

an identifying step of generating information for 
identifying the start data in the buffer, based on 
the analysis result from the analyzing step and 
the control from the control step. 

20. A medium having recorded thereon a computer read- 
able program for a computer to execute a decode 
processing method for decoding data stored in a 
buffer by using information for identifying start data 
containing start information that is included in data 
stored in the buffer, 

wherein the program recorded in the medium causes 
a computer to execute: 

a reading-out step of reading out data from the 
buffer with a predetermined timing; 
a separating step of separating the start data 
contained in the data read out into start informa- 
tion and data based on information for identifying 
the start data; and 

a decoding step of performing a decode process 
for the data read out based on the start informa- 
tion. 

21. An integrated circuit to be incorporated into a device 
which processes packets in which variable length 
data is split and stored, 
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wherein the device comprises a buffer for storing da- 
ta, and 

wherein the integrated circuit integrates circuitry 
functioning as: 

5 

a header analyzing section for analyzing a head- 
er of an inputted packet, and determining wheth- 
er data stored in a payload is start data contain- 
ing start information or other data; 
a data extracting section for referring to an anal- »o 
ysis result from the header analyzing section, 
and extracting the data from the payload in the 
packet; 

abufferforstoringthedata extracted by the data 
extracting section; '5 
a buffer controlling section for controlling a 
stored position and an accumulated data 
amount of the data in the buffer; and 
a start data identifying section for generating in- 
formation for identifying the start data in the buff- 20 
er, based on the analysis result from the header 
analyzing section and the control by the buffer 
controlling section. 

22. The integrated circuit according to claim 21 further 25 
integrates circuitry functioning as 
a decode section for reading out data from the buffer 
with a predetermined timing, obtaining information 
for identifying the start data from the start data iden- 
tifying section, separating the start data contained in so 
the data read out based on the stored position infor- 
mation and the count number into start information 
and data, and performing a decode process for the 
data read out based on the start information. 
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